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Tonunaso  Toffoli 

MIT  Laboratory  for  Computer  Science 
545  Technology  Sq.,  Cambridge,  MA  02139 


Abstract.  The  theory  of  reversible  computing  is  based  on  invertible'' 
primitives  and  composition  rules  that  preserve  invertibility.  With  these  con¬ 
straints,  one  can  still  satisfactorily  deal  with  both  functional  and  structural 
aspects  of  computing  processes;  at  the  same  time,  one  attains  a  closer  cor¬ 
respondence  between  the  behavior  of  abstract  computing  systems  and  the 
microscopic  physical  laws  (which  a*e  presumed  to  be  strictly  reverble)  that 
underly'any  concrete  implementation  of  such  systems. 

Here,  we  integrate  into  a  comprehensive  picture  a  variety  of  concepts 
and  results.  According  to  a  physical  interpretation,  the  central  ran!'.  of  this 
paper  is  that  it  is  ideally  possible  to  build  sequential  circuits  with  sera  uternaf 
power  dissipation.  Even  when  these  circuits  are  interfaced  with  .sjweutional 
ones,  power  dissipation  at  the  interface  would  be  at  moat  pwpei  l.foaal  tv 
the  number  of  input/output  lints,  rather  than  to  the  number  of  logic  gat; 
as  in  conventional  computers. 

Keywords.  Reversible  computing,  computat-yn  urirmaality, 
automata,  computing  networks,  physical  computing. 


1.  Introduction 

Mathematical  models  of  computation  are  abstract  »mstnn'tions.  b  •  IMe 
nature  unfettered  by  physical  laws.  However,  if  these  n.s-Mk  arc  *.»  give  i»v* 
dications  that  are  relevant  to  concrete  computing,  they !  nut  somehe  w  'Apt  -t&, 
albeit  in  a  selective  and  stylized  way,  certain  genera)  physical  restriction;  to 
which  all  concrete  computing  processes  are  subjected.  '  -  ?  instance,  the  T  ring 
machine,  which  embodies  in  a  heuristic  form  the  aiicv:  o{  computability  tSeory, 
avowedly  accounts  in  its  design[24]  for  the  fact  that  .he  speed  of  propagation 
of  information  is  bounded,  and  that  the  amount  of  '^formation  which  can  be 
encoded  in  the  state  of  a  finite  system  is  bounded.  However,  other  physh^tl 

*Tbis  research  was  supported  by  Grant  N00014-7S-C-0681,  Office  of  Naval 
Research,  funded  by  DARPA. 
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principles  of  comparable  importance,  such  as  the  reversibility  at  a  microscopic 
level  of  the  dynamical  laws  (which  imposes  severe  constraints  on  the  operation  of 
concrete  computing  primltives[12,23])  and  the  fact  that  the  topology  of  spacetime 
is  locally  Euclidean  (which  severely  limits  the  range  of  interconnection  patterns 
for  concrete  computing  structures[19]),  are  not  yet  adequately  represented  in 
the  theory  of  computing.  Conceivably,  a  better  match  between  the  abstract 
conatniets  of  the  theory  and  its  applications  would  be  attained  if  a  suitable 
counterpart  of  these  principles  were  incorporated  in  the  theory. 

Here,  we  shall  be  concerned  with  the  issue  of  reversibility.  Intuitively,  a 
dynamical  system  is  reversible  if  from  any  point  of  its  state  set  one  can  uniquely 
trace  a  trajectory  backward  as  well  as  forward  in  time.  For  a  time-discrete 
system  such  as  an  automaton,  this  is  equivalent  to  saying  that  its  transition 
function  is  invertible,  that  is,  bijective.  The  concept  of  reversibility  has  its 
origins  in  physics,  and,  in  particular,  in  the  study  of  continuous  systems,  such 
aj  those  characterized  by  a  differential  equation,  rather  than  discrete  systems, 
which  are  characterized  by  a  transition  lunction.  In  the  continuous  case,  a  more 
technical  definition  is  necessary;  namely,  a  dynamical  system  is  reversible  if 
its  dynamical  semigroup  can  be  expanded  to  a  group[14].  The  connection  be¬ 
tween  these  two  definitions  is  immediate,  since  in  the  discrete  caBe  the  transition 
function  coincides  with  the  generator  of  the  system’s  semigroup. 

It  should  be  noted  that  reversibility  does  not  imply  invariance  under  time 
reversal;  the  latter  is  a  more  specialized  notion  which  is  definable  in  a  nontrivial 
way  only  for  dynamical  systems  having  additional  structure. 

In  the  past,  some  misgivings  were  expressed  concerning  the  computing 
capabilities  of  reversible  automata.  Such  misgivings  were  cleared  by  the  work  of 
Bennett  (reversible  Turing  inachines[4]),  Priese  (reversible  computers  embedded 
in  Thue  sy8tems[]7]),  Fredkin  (conservative  logicjT)),  and  Toffoli  (reversible  cel¬ 
lular  automata[20]).  Today,  the  concept  of  reversible  computing  appears  to  be 
not  only  productive  from  a  theoretical  viewpoint  but  also  promising  in  terms 
of  technological  applications^]. 

In  fact,  one  of  the  strongest  motivations  for  the  study  of  reversible  comput¬ 
ing  comes  from  the  desire  to  reduce  heat  dissipation  in  computing  machinery, 
and  thus  achieve  higher  density  and  speed.  Briefly,  while  the  laws  of  physics 
are  presumed  to  be  strictly  reversible,  abstract  computing  is  usually  thought  of 
as  an  irreversible  process,  since  it  may  involve  the  evaluation  of  many-to-onc 
functions.  Thus,  as  one  proceeds  down  from  an  abstract  computing  task  to  a 
formal  realization  by  means  of  a  digital  network  and  finally  to  an  implementation 
in  a  physical  system,  at  some  level  of  this  modeling  hierarchy  there  must  take 
place  the  transition  from  the  irreversibility  of  the  given  computing  process  to 
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the  reversibility  of  the  physical  laws.  In  the  customary  approach,  this  transition 
occurs  at  a  very  low  level  and  is  hidden — so  to  speak — in  the  “physics"  of  the 
individual  digital  gate;*  as  a  consequence  of  this  approach,  the  details  of  the 
work-to-heat  conversion  process  are  put  beyond  the  reach  of  the  conceptual 
model  of  computation  that  is  used. 

On  the  other  hand,  it  is  possible  to  formulate  a  more  general  conceptual 
model  of  computation  such  that  the  gap  between  the  irreversibility  of  the  desired 
behavior  and  the  reversibility  of  a  given  underlying  mechanism  is  bridged  in  an 
explicit  way  within  the  model  itself.  This  we  shall  do  in  the  present  paper. 

An  important  advantage  of  our  approach  is  that  any  operations  (such  as 
the  clearing  of  a  register)  that  in  conventional  logic  lead  to  the  destruction  of 
macroscopic  information,  and  thus  entail  energy  dissipation,  here  can  be  planned 
at  the  whole-circuit  level  rather  thau  at  the  gate  level,  and  most  of  the  time 
can  be  replaced  by  an  information-lossless  variant.  As  a  consequence,  ft  appears 
possible  to  design  circuits  whose  internal  power  dissipation,  under  ideal  physical 
circumstances,  is  zero.  The  power  dissipation  that  would  arise  at  the  interface 
between  such  circuits  and  the  outside  world  would  be  at  most  proportional  to 
the  number  of  input/output  lines,  rather  than  to  the  number  of  logic  gates. 

2.  Terminology  and  notation 

A  function  <j> :  X— *  Y  is  finite  if  X  *nd  Y  are  finite  sets.  A  finite  automaton  is 
a  dynamical  system  characterized  by  a  transition  function  of  the  form  r:XX 
Q—*QX  Y,  where  r  is  finite. 

Without  loss  of  generality,  one  may  ass*"'*  that  such  jets  as  X,  Y,  and 
Q  above  be  explicitly  given  as  indexed  Cartesi#.  >roducts  of  sets.  We  shall 
occasionally  call  lines  the  individual  variables  associated  with  the  individual 
factors  of  such  products.  By  convention,  the  Cartesian  product  of  zero  factors 
is  identified  with  the  dummy  set  {X}  consisting  of  the  empty  word  X.  In  what 
follows,  we  shall  assume  once  and  for  all  that  all  factors  of  the  aforementioned 
Cart  -sian  products  be  identical  copies  of  the  Boolean  set  B  *=■  {0, 1}.  This 
assumption  entails  little  loss  of  generality,  and— at  any  rate — the  theory  of 
reversible  computing  could  be  developed  along  essentially  the  same  lines  if  such 
assurnptio  i  were  dropped. 

’Typically  ~tbe  computation  is  logi  ally  organized  around  computing  primitives 
that  arc  not  invertible,  such  as  the  nand  gate;  in  turn,  these  are  realized  by  physical 
devices  whi>  h,  while  by  their  nature  obeying  reversible  microscopic  laws,  are  made 
macroecopicully  irreversible  by  allowing  them  to  convert  some  work  to  heat. 


The  concept  of  "function  composition"  is  a  fundamental  one  in  the  theory  of 
computing.  According  to  the  ordinary  rules  for  function  composition,  an  output 
variable  of  one  function  may  be  substituted  for  any  number  of  input  variables  of 
other  functions,  i.e.,  arbitrary  "fan-out”  of  lines  is  allowed.  However,  the  process 
of  generating  multiple  copies  of  a  given  signal  must  be  treated  with  particular 
care  when  reversibility  is  an  issue  (moreover,  from  a  physical  viewpoint  this 
process  is  far  from  trivial).  For  this  reason,  in  all  that  follows  we  shall  restrict  the 
meaning  of  the  term  "function  composition"  to  one-to-one  composition,  where 
any  substitution  of  output  variables  for  input  variables  is  one-to-one  (in  other 
words,  no  fan-out  of  lines  is  allowed).  Any  fan-out  node  in  a  given  function- 
composition  scheme  will  have  to  be  treated  as  an  explicit  occurrence  of  a  fan-out 
function  of  the  form  (x)  ►-*(*....,  x).  Intuitively,  the  responsibility  for  providing 
fan-out  is  shifted  from  the  composition  rules  to  the  computing  primitives. 

We  Bhall  be  dealing  with  various  classes  of  abstract  computers  (such  as  com¬ 
binational  networks,  finite  automata,  Turing  machines,  and  cellular  automata) 
which  constitute  the  main  paradigms  of  the  theory  of  computing.  An  abstract 
computer  is,  in  essence,  a  function-composition  scheme,*  and  a  computation  is 
a  particular  solution  (which  may  be  required  to  satisfy  certain  boundary  condi¬ 
tions  or  other  constraints)  of  such  a  scheme.  While  finite  composition  schemes 
are  adequate  for  dealing  with  the  most  elementary  aspects  of  computing,  many 
computing  processes  of  interest  require  an  unbounded  amount  of  resources  and 
are  more  conveniently  represented  as  taking  place  in  infinite  schemes. 

It  is  customary  to  express  a  function-composition  scheme  in  graphical  form 
as  a  causality  network  (cr  functional-dependence  network).  This  is  basically  an 
acyclic  directed  graph  whose  nodes  are  labeled  by  associating  with  each  of  them 
a  particular  finite  function  and  whose  arcs  are  colored  by  associating  with  each 
of  them  a  pai  ticular  variable.  (Here,  we  can  safely  ignore  certain  slight  technical 
differences  between  a  causality  network  and  a  directed  graph.) 

By  construction,  causality  networks  are  “loop-free,”  i.e.,  they  contain  no 
cyclic  paths.  A  combinational  network  is  a  causality  network  that  contains  no 
infinite  paths.  Note  that  a  finite  causality  network  is  always  a  combinational 
one. 

With  certain  additional  conventions,  causality  networks  having  a  particular 
iterative  structure  can  be  represented  more  compactly  as  sequential  networks 
(cf.  Section  7). 

We  shall  assume  familiarity  with  the  concept  of  “rcsiir-ation”  of  finite  func- 

vIn  what  follows,  we  shall  restrict  our  attention  to  function-compoiTtlonschsmes 
based  on  finite  primitives. 
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tions  and  automata  by  mesas  of,  respectively,  combinational  and  sequential 
networks.  In  what  follows,  a  "realisation"  will  always  mean  a  componentwise 
one;  that  is,  to  each  input  (or  output)  line  of  a  finite  function  there  will  cor¬ 
respond  an  input  (or  output)  line  in  the  combinational  network  that  realizes  it, 
and  similarly  for  the  realization  of  automata  by  sequential  networks. 

A  causality  network  is  reversible  if  it  is  obtained  by  composition  of  inver¬ 
tible  primitives.  Note  that  a  reversible  combinational  network  always  defines  an 
invertible  function.  Thus,  in  the  case  of  combinational  networks  the  structural 
aspect  of  "reversibility"  and  ihe  functional  aspect  of  "invertibility”  coincide. 
A  sequential  network  m  reversible  if  its  combinational  part  (i.e.,  the  combina¬ 
tional  network  obtained  by  deleting  the  delay  elements  and  thus  breaking  the 
corresponding  arcs)  is  reversible. 


3.  In  «?ductory  concepts 

As  explained  in  Section  1,  our  overall  goal  is  to  develop  an  explicit  realiza¬ 
tion  of  computing  processes  within  the  context  of  reversible  systems.  For  the 
moment,  the  processes  we  shall  deal  with  v.ill  be  those  described  by  finite  func¬ 
tions,  and  the  systems  used  for  their  realization  will  be  reversible  combinational 
networks.  Later  on,  we  shall  consider  sequential  processes,  characterized  by  the 
presence  of  internal  states  in  addition  to  input  and  output  states,  and  we  shall 
study  their  realization  by  means  of  reversible  sequential  networks. 

As  an  introduction,  let  us  consider  two  simple  functions,  namely,  fatmhit 
(3.1a)  and  xor  (3.1b): 


xi*i  y 

X 

MVS 

0  0  0 

(a)  J 

0  0 

1 1 

<fc)  ti  -  i- 

1  1  •  (3.1) 

KAN-OUT 

yi  =  z 

XOH 

^30-*—  y  =  *i©is 

%2 

Neither  of  these  functions  is  invertible.  (Indeed,  fan-out  is  not  surjective,  since, 
for  instance,  the  output  (0, 1)  cannot  be  obtained  for  any  input  value;  and  xen 
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is  not  injective,  since,  for  instance,  the  output  0  can  be  obtained  from  two  dis¬ 
tinct  input  values,  (6,0)  and  (1,1)).  Yet,  bath  functions  admit  cf  an  invertible 
realization. 


To  see  this,  consider  the  invertible  function  xor/famout  defined  by  the 
table 


00  R0 

01  .  11 

1%  10’ 

11  01 


(3.2) 


which  we  have  copied  over  with  different  headings  in  (3.3a),  (3.3b),  and  (3.6b). 
Then,  fan-out  can  be  realized  by  means  of  this  function*  as  in  (3.3a)  (where 
we  have  outlined  the  relevant  table  entries),  by  assigning  a  value  of  0  to  the 
auxiliary  input  component  q  and  xor  can  be  realized  by  means  of  the  same 
function  as  in  (3.3b),  by  simply  disregarding  the  auxiliary  output  component 
g.  In  more  technical  terms,  (3.1a)  is  obtained  from  (3.3a)  by  componentwise 
restriction,  and  (3.1b)  from  (3.3b)  by  projection. 
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mi 
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c  —  0 


I 

g(=  « 


=  Xl©®2 


In  vhat  follows,  we  shall  collectively  call  the  source  the  auxiliary  input 
compo:  ents  that  have  been  used  in  a  realization,  such  as  component  c  In  (3.3a), 
and  tb .  sink  the  auxiliary  output  components  such  as  g  in  (3.3b).  The  remaining 
input  components  will  be  collectively  called  the  argument,  and  the  remaining 
output  components,  the  result 

In  general,  both  source  and  sink  lines  will  have  to  be  introduced  in  ok'-c 

^Ordinarily,  one  speaks  of  a  realization  “by  a  network."  Note,  though,  that  s 
finite  function  by  itself  constitutes  a  trivial  case  of  combinational  network. 
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to  construct  an  invertible  realisation  of  a  given  function. 


*i*2  y 

ooo  *  y 

M  Si  W  1  -  { 
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(3.4) 
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NOT 


For  example,  from  the  invertible  function  and/nand  defined  by  the  table 


000  000 
001  001 
010  010 
Oil  011 
100  100’ 
101  101 
110  110 
111  011 


(35) 


the  and  function  (3.4a)  can  be  realized  as  in  (3.6a)  with  one  source  line  and  two 
sink  lines. 


cxiTi  y  gift 
oBD®  E]o  o 
o®m  Eloi 
o[QGfl  IS  i  o 

w  sum)  -*iiiii 

100  100 
101  101 
no  no 
111  on 

c  =  0 
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Observe  that  in  order  to  obtain  the  desired  result  the  source  lines  must  be 
fed  with  specified  constant  values,  i.e.,  with  values  that  do  not  depend  on  the 
argument.  As  for  the  sink  lines,  some  may  yield  values  that  do  depend  on  the 
argument — as  in  (3.0a) — and  thus  cannot  be  used  as  input  constants  for  a  new 
computation;  these  will  be  called  garbage  lines.  On  the  other  b'rnd,  some  sink 
lines  may  return  constant  values;  indeed,  this  happens  whenever  the  functional 
relationship  between  argument  and  result  is  itself  ss  invertible  one.  To  give  a 
trivial  example,  suppose  that  the  not  function  (3.4b),  which  is  invertible,  were 
not  available  as  a  primitive.  In  this  case  one  cjuld  still  realize  it  starting  from 
another  invertible  function,  e.g.,  from  the  xor/fan-out  function  as  in  (3.6b); 
note  that  here  the  sink,  d,  returns  in  any  case  the  value  present  at  the  source,  c. 
In  general,  if  there  exists  between  a  set  of  source  lines  and  a  set  of  shk  lines  an 
invertible  functional  relationship  that  is  independent  of  the  value  of  all  other 
input  lines,  then  this  pair  of  sets  will  be  called  (for  rearous  that  will  be  made 
clear  in  Section  5)  a  temporary-storage  channel. 

Using  the  terminology  just  established,  we  shell  say  that  the  above  realiza¬ 
tion  of  the  fan-out  function  by  means  of  an  invertible  combinational  function 
is  a  realization  with  constants,  that  of  the  xon  function,  with  garbage,  that  of 
the  and  function,  with  constants  and  garbage,  and  that  or  the  not  function, 
with  temporary  storage  (for  the  sake  of  nomenclature,  the  source  lima  that  are 
part  of  a  temporary-storage  channel  will  not  be  counted  as  lines  of  constants). 
In  referring  to  a  realization,  features  that  are  not  explicitly  mentioned  will  be 
assumed  not  to  have  been  UBed;  thus,  a  realization  “with  temporary  storage” 
is  one  without  constants  or  garbage.  A  realization  that  does  not  require  any 
source  or  sink  lines  will  be  called  an  isomorphic  realization. 


4.  The  fundamental  theorem 

In  the  light  of  the  particular  examples  discussed  in  the  previous  section,  this 
section  establishes  a  general  method  for  realizing  an  arbitrary  finite  function  <fi 
by  means  of  an  invertible  finite  function  /. 

Here,  we  are  concerned  with  realizations  in  the  sense  defined  in  Section  2. 
In  more  general  mathematical  parlance,  a  realization  of  a  function  <j>  consists  of 
o  new  function  /  together  with  two  mappings  p  and  u  (respectively,  the  encoder 
and  the  decoder)  such  that  <j>  =  vfp.  In  this  context,  our  plan  is  to  obtain 
a  realization  vfp  of  such  that  /  is  invertible  and  the  mappings  p  and  i>  are 
essentially  independent  of  <f>  and  contain  as  little  “computing  power"  as  possible. 
More  precisely,  though  the  form  of  p  and  u  must  obviously  reflect  the  number 
of  input  and  output  components  of  and  thus  the  format  of  <f>’ s  truth  table, 
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we  want  them  to  be  otherwise  independent  of  the  particular  contents  of  such 
truth  table  as  ^  is  made  to  range  over  the  set  of  all  combinatorial  functions. 

In  general,  given  any  finite  function  one  obtains  a  new  one  by  assigning 
specified  values  to  certain  distinguished  input  lines  (source)  and  disregarding 
certain  distinguished  output  lines  (sint).  According  to  the  following  theorem, 
any  finite  function  can  be  realized  in  this  way  starting  from  a  suitable  invertible 
one. 


Theorem  4.1  For  every  finite  function  <j>:  B’n-'.3n  there  exists  an  i aver¬ 
tible  finite  function /:B'XBm-tB"X  jjr+m—n.  *,•{{, r<.n,  such  that 


f 


/{0 . 0,*i . —  ^(*1 . *„),  (i  —  1 . n).  (4.1) 


Proof.  Let  <f>  be  defined  by  a  binary  table  of  the  following  form 

’-db  -  dh . 

where  X  denotes  a  listing  of  all  2m  m-tuples  over  B  and  Y  denotes  a  listing 
of  the  corresponding  values  of  <$>,  which  are  n>tuplrs  over  B.  V/c  shall  define  a 
function  / :  B"+m  -4  B'v^m  by  means  of  the  following  table 


n  m  n  m 


0  1 

X 

1 

Y 

X 

1  1 

\  X 

y+ 1 

X 

... 

_ 

... 

... 

X 

1 

r+2B-i 

X 

where  each  block  of  the  form  k  (0  <  fc  <  2”)  consists  of  2m  identical  n-tuples 
each  representing  the  integer  fc  written  in  base  2,  while  each  block  of  the  form 
Y  +  fc  (0  <  fc  <  2")  consists  of  the  2m  entries  of  Y  each  treated  as  a  base* 
2  integer  and  incremented  bv  fc  mod  2".  (So  the  sequence  of  “Y  -f-  fc"  blocks 
differs  from  the  “fc"  sequence  only  by  a  circular  permutation.)  By  construction, 
each  side  of  this  table  contains  each  element  of  Bn+m  exactly  once.  Thus,  /  is 
invertible.  Moreover,  equation  (4.1),  with  r—  n,  bolds  by  construction.B 
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The  meaning  of  Theorem  4.1  is  illustrated  in  Figure  4.1  below.  The  opera¬ 
tions  of  restriction  and  projection  mentioned  in  Section  3  are  respectively  per¬ 
formed  by  an  input  encoder  p  and  an  output  decoder  u.  While  letting  through 
the  argument  ,  ...,1m)  unchanged,  the  encoder  supplies  the  r  source  lines 
with  constant  values,  i.e.,  with  values  that  do  not  depend  on  the  argument  itself. 
On  the  other  hand,  while  letting  through  the  result  (|fl,  •  •  • , Ifa)  unchanged,  the 
u-xoder  absorb*  whatever  values  come  out  of  the  the  ro  -f-  r  —  n  sink  lines. 

4> 


Fic.  4.1  Any  Suite  function  4  can  be  written  as  the  product  of  a  trivial 
encoder  n,  an  invertible  Unite  function  /,  and  a  trivial  decoder  v. 


Intuitively,  such  a  realization  of  by  means  of  an  invertible  function  /  is  “fair," 
in  the  sense  that  neither  p  nor  v  contribute  to  the  “computing  power”  of  /. 


Since  p  does  not  interact  with  the  input  signals,  it  will  be  more  convenient 
to  visualize  it  as  a  separate  source  of  constant  input  values,  as  in  Figure  4.2b 
rather  than  as  an  input  encoder,  as  in  Figure  4.1;  likewise,  v  is  more  conveniently 
visualized  as  a  separate  sink  of  output  values  rather  than  as  an  output  decoder. 
To  sam  up,  whatever  can  be  computed  by  an  arbitrary  finite  function  according 
to  the  schema  of  Figure  4.2a  can  also  be  computed  by  an  invertible  finite  function 
according  to  the  schema  of  Figure  4.2b. 


1C 


Fig.  4.2  Any  Unite  function  (a)  can  be  readied  as  an  invertible  finite 
function  (b)  having  a  number  of  auxiliary  input  lines  which  are  fed  with 
constants  and  a  number  of  auxiliary  output  lines  whose  values  are  dis¬ 
regarded. 


Remark.  The  construction  in  the  proof  of  Theorem  4.1  does  not  necessarily 
lead  to  a  minimal  realization,  as  often  the  number  of  source  lines  can  be  made 
strictly  less  than  n  and,  correspondingly,  the  number  of  sink  lines  strictly  less 
than  m.  Intuitively,  in  many  cares  the  given  function  4>  is  such  that  much  of 
the  information  contained  in  the  argument  is  retained  in  the  result,  ao  that  in 
order  to  guarantees  invertibility  /  need  only  preserve  in  the  garbage  signals  a 
fraction  of  the  total  information. 


5.  Invertible  primitives  and  reversible  networks 

In  the  prr'ious  section,  each  given  <f>  was  realized  by  a  reversible  combina¬ 
tional  network  consisting  of  a  single  occurrence  of  an  ad  hoc  primitive  /.  In  this 
section,  we  shall  study  the  realization  of  arbitrary  finite  functions  by  means 
of  reversible  combinational  networks  constructed  from  given  primitives;  in  par¬ 
ticular,  from  a  certain  finite  set  U  of  very  simple  primitives. 

If  the  given  function  (j>  is  defined  by  means  of  an  arbitrary  combinational 
network  (in  what  follows,  we  shall  assume  for  simplicity  that  this  network  be 
based  on  the  nand  element),  a  reversible  realization  of  <p  based  on  the  set  U  can 
be  obtained  in  a  very  simple  way  by  subjecting  the  given  network  to  straightfor¬ 
ward  translation  rules.  However,  the  reversible  realization  that  is  obtained  in 
this  way  in  general  requires  many  more  sink  line*  (and,  consequently,  many  more 
source  lines)  than  the  realization  of  Section  4.  On  the  other  band,  starting  from 
the  same  set  U  of  primitives  but  using  more  sophisticated  synthesis  techniques  it 
is  p  ussible  to  obtain  a  reversible  realization  of  <p  that  does  not  require  any  more 
garbage  lines  than  when  realizing  ^  by  means  of  an  ad  hoc  primitive  /.  In  fact, 
/  itself — or,  for  that  matter,  any  invertible  finite  function— esu  be  synthesized 


from  U  without  garbage,  though  possibly  with  temporary  storage. 

In  this  synthesis,  the  peculiar  constraints  dictated  by  the  reversibility  con¬ 
text  force  one  to  pay  attention  to  a  number  of  issues,  such  as  fan-out,  temporary 
storage,  and  the  handling  of  constants  and  garbage,  which  do  not  arise — or,  at 
any  rate,  are  not  critical— when  these  constraints  are  not  present.  As  a  counter¬ 
part,  the  structure  of  the  networks  that  are  thus  obtained  provides  more  realistic 
indications  of  what  an  efficient  physical  implementation  of  the  corresponding 
computing  processes  would  have  to  be  like. 

It  is  well  known  that,  under  the  ordinary  rules  of  function  composition, 
the  two-input  nano  element  constitutes  a  universal  primitive  for  the  set  of  all 
combinational  functions. 

In  the  theory  of  reversible  computing,  a  similar  role  is  played  by  the  and/nand 
element,  defined  by  (3.5)  and  graphically  represented  as  in  Figure  5.1c.  Referring 
to  (3.6a),  observe  that  y  ■=»  i\&i  (and  function)  when  c  =  0,  and  y  •=>  (nand 
function)  when  c  =  1.  Thus,  as  long  as  one  supplies  a  value  of  1  to  input  c  and 
disregards  outputs  gi  and  35,  the  and/nand  element  can  be  substituted  for  any 
occurence  of  n  nand  gate  in  an  ordinary  combinational  network. 

In  spite  of  having  ruled  out  fan-out  as  an  intrinsic  feature  provided  by  the 
composition  rules,  one  can  still  achieve  it  as  a  function  realised  by  means  of 
an  invertible  primitive,  such  as  the  xoh/fan-out  element  defined  by  (3.2)  and 
graphically  represented  as  in  Figure  5.1b.  In  (3.3a),  observe  that  yi  =  yi  ■=  i 
when  c  ■=  0  (fan-out  function);  and  in  (3.3b),  that  y  *=  xi  ©  xz  (xon  function). 

Finally,  recall  that  finite  composition  always  yields  invertible  functions  when 
applied  to  invertible  functions  (cf.  Section  2). 

Therefore,  UBicg  the  set  of  invertible  primitives  consisting  of  the  and/nand 
element  and  the  xor/f~n-out  element,  any  combinational  network  can  be  im¬ 
mediately  translated  into  a  reversible  one  which,  when  provided  with  appropriate 
input  constants,  will  reproduce  the  behavior  of  the  original  network.  Indeed, 
even  the  set  U  consisting  of  the  single  element  and/nand  is  sufficient  for  this 
purpose,  since  xor/fan-out  can  be  obtained  from  and/nand,  with  one  line  of 
temporary  storage,  by  taking  advantage  of  the  mapping  (i, p,  q)  (1,  p, p  ©3).) 

The  element-by-eiement  substitution  procedure  outlined  above  for  construct¬ 
ing  a  reversible-network  realization  of  a  given  combinational  function  is  wasteful, 
in  the  sense  that  the  number  of  source  and  sink  lines  that  are  introduced  by  this 
construction  is  roughly  proportional  to  the  number  of  computing  elements  that 
make  up  the  network,  and  therefore  in  general  much  larger  than  the  minimum 
required  to  compensate  for  the  noainvertibility  of  the  given  function  (cf.  Section 

4). 
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From  the  viewpoint  of  a  physical  implementation,  where  signals  ere  encoded 
in  some  form  of  energy,  each  constant  input  entails  the  supply  of  energy  of 
predictable  form,  or  work,  and  each  garbage  output  entails  the  removal  of  energy 
of  unpredictable  form,  or  heat.  In  this  context,  a  realization  with  fewer  source 
and  sink  lines  might  point  the  way  to  a  physical  implementation  that  dissipates 
less  energy. 

Our  plan  to  achieve  a  less  wasteful  realization  will  be  based  on  the  following 
concept.  While  it  ir  ,'rue  that  each  garbage  signal  is  "random,”  in  the  sense 
that  it  is  not  predictable  without  knowing  the  value  of  the  argument,  yet  it  will 
be  correlated  with  other  signals  in  the  network.  Taking  advantage  of  this,  one 
can  augment  the  network  in  such  a  way  as  to  make  correlated  signals  interfere 
with  one  another  and  produce  a  number  of  constant  signals  instead  of  garbage. 
These  constants  can  be  used  as  source  signals  in  r.ther  parts  of  the  network.  In 
this  way,  the  overall  number  of  both  source  and  rink  lines  can  be  reduced.  This 
process  is  analogous  to  the  destructive  interferei.ee  of,  say,  sound  waves.  It  is 
well-known  that  by  superposing  two  correlated  random  signals  one  may  obtain 
an  overall  signal  which  is  less  "noisy"  that  either  component. 

In  the  remainder  of  this  section  we  shall  show  how,  in  the  abstract  context 
of  reversible  computing,  destructive  interference  of  correlated  signals  can  be 
achieved  in  a  systematic  way.  For  a  similar  process  of  destructive  interference 
to  take  place  in  concrete  computers  (thus  leading  to  greatly  reduced  power 
dissipation),  one  would  have  to  match  the  abstract  invertible  primitives  with 
digital  gates  taht  are  macroscopically — as  well  as  microscopically — reversible. 
The  arguments  in  [7,8,23]  strongly  suggest  that  such  gates  are  indeed  physically 
realizable. 

Returning  to  our  mathematical  exposition,  we  shall  first  show  that  any  in¬ 
vertible  finite  function  can  be  realized  isoinorphicaliy  from  certain  generalized 
and/nand  primitives.  Then,  we  shall  show  that  any  of  these  primitives  can  be 
realized  from  the  and/nand  element  possibly  with  temporary  storage  but  with 
no  garbage. 

For  convenience,  we  shall  say  that  an  invertible  finite  function  is  of  order  r» 
if  it  has  n  input  lines  and  n  output  lines. 

Definition  5.1  Consider  the  set  B  “»  {0,1}  with  the  usual  structure  of 
Boolean  ring,  with  “0"  (exclusive-on)  denoting  the  addition  operator,  “©" 
the  additive-inverse  operator  (which  in  this  case  coincides  with  the  identity 
operator),  and  juxtaposition  (and)  the  multiplication  operator.  For  any  n  >  0, 
the  generalized  and/nand  tasetioa  of  order  n,  denoted  by  6^:  B"  — ♦  B",  is 
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defined  by 


(*l  \ 

f  *i 

*2 

J 

; 

Xn—  1 

*n— 1 

i 

*1*3- 

Remark,  (a)  The  ©  sign  in  (5.1),  which  is  redundant  (since  ©x«  =  *„),  has 
been  introduced  for  ease  of  comparison  with  the  arguments  of  [23].  (b)  For  any 
n  >  0,  is  invertible  and  coincides  with  its  inverse,  (c)  For  ti»=  1,2,...,  n — 1, 
the  i-th  component  of  fiW,  i.e.,  6\n\  coincides  with  the  projection  operator  for 
the  corresponding  argument,  i.e.,  0[n\x\ , . . . ,  i„)  <=*=  i,-.  (d)  The  last  component 
of  flM,  i.e.,  0M,  coincides  with  the  not  function  for  n  ■=  1  (note  that,  by 
convention,  *r  1  when  i  ■=■  0),  and  with  the  eiclusive-oR  of  its  two 

arguments  for  n  «=*  2.  (e)  For  all  other  values  of  n,  is  still  linear  in  the  n- 
th  argument,  but  is  nonlinear  in  the  first  n  —  1  arguments. 

We  have  already  encountered  6 W  under  the  name  of  the  not  element,  Bl'"! 
under  the  name  of  the  xor/fan-out  element,  and  fiW  under  the  name  of  the 
and/nand  element.  The  generalised  and/nand  functions  are  graphically  repre¬ 
sented  as  in  Figure  5.1d. 


(a) 


; - r 


NOT 


(b) 


(c) 


AND/NAND 


generalized  and/nand 


Fig.  5.1  Graphic  representation  of  the  generalised  and/nand  functions. 
Warning:  This  representation  is  olfered  only  as  a  mnemonic  aid  in  recalling 
a  function's  truth  table,  and  is  not  meant  to  imply  any  "internal  structure” 
for  the  function,  or  suggest  any  particular  implementation  mechanism. 
(a)  flW,  which  coincides  with  the  not  element;  (b)  0^\  which  coincides 
with  the  xoR/rAN.ouT  element;  (c)lP\  which  coincides  with  the  and/nand 
element;  and,  in  general,  (d)  s'n\  the  generalised  and/nand  function  of 
order  n.  The  bilateral  symmetry  of  these  symbols  recalls  the  fact  that  each 
of  the  corresponding  functions  coincides  with  its  inverse. 
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An  invertible  function  acts  as  a  permutation  on  the  elements  of  its  domain, 
and  it  is  well  known  that  any  permutation  can  be  written  as  a  product  of  elemen¬ 
tary  permutations,  i.e.,  of  permutations  that  exchange  exactly  two  elements. 
In  our  attempt  to  synthesize  arbitrary  invertible  functions  of  order  n  we  shall 
consider,  as  building  blocks,  elementary  permutations  on  B"  and  even  more 
basic  permutations  on  Bn  called  atomic  permutations. 


Definition  5.2  In  the  truth  table  for  the  and/nand  element  (3.5),  observe 
that  the  only  difference  between  the  left-  and  the  right-hand  side  of  the  table 
is  that  exactly  two  rows  (namely,  (0,1,1)  and  (1,1,1))  which  have  a  Hamming 
distance  of  1  (i.e.,  differ  in  exactly  one  position)  have  been  exchanged.  An  atomic 
permuter  is  any  function  having  this  property. 


Any  atomic  permuter  of  order  n  can  be  constructed  from  the  generalized 
and/nand  element  of  order  n  by  appending  not  elements  to  some  of  the  input 
lines  and  to  each  of  the  corresponding  output  lines,  as  in  Figure  5.2a.  Graphically, 
this  permuter  will  be  represented  as  in  Figure  5.2b,  where  some  of  the  inputs 
to  the  AND-gate  symbol  are  negated  (as  denoted  by  a  little  circle). 


Fiq.  5.2  (a)  Construction  and  (b)  graphic  representation  of  a  particular 
atomic  permuter. 


Theorem  5.1  Any  invertible  finite  function  of  order  n  can  be  obtained  by 
composition  of  atomic  permuters  of  order  n,  and  therefore  by  composition  of 
generalized  and/nand  functions  of  order  <  n. 

Proof.  It  will  be  sufficient  to  show  that  one  can  obtain  any  elementary 
permutation  on  Bn. 

In  a  table  of  all  elements  of  B",  a  sequence  of  table  entries  . . .  (these 

are  all  n-tuples)  are  said  to  form  a  Gray-code  path  if  any  two  entries  that  are 
adjacent  in  this  sequence  are  related  by  an  atomic  permutation.  Consider  the 
pair  of  entries  x  and  y  that  we  wish  to  exchange,  o..d  consider  a  Gray-code  path 
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from  x  to  y  (such  a  path  exists  for  any  pair  x,  y).  It  is  easy  to  verify  that  by 
means  of  sequence  of  atomic  permutations  item  x  can  be  moved  to  the  end  of 
the  path,  while  the  remainder  of  the  path  is  shifted  one  position  to  the  left  but 
is  otherwise  unchanged.  In  a  similar  way,  y  can  be  brought  to  the  beginning 
of  the  path.  Thus  x  and  y  can  be  exchanged  by  means  of  a  sequence  of  atomic 
permutations  without  affecting  the  rest  of  the  table.| 

Remark.  Note  that  the  realization  referred  to  by  Tneorem  5.1  is  an  isomor¬ 
phic  one  (unlike  that  of  Section  4,  which  makes  use  of  source  and  sink  lines). 

Theorem  5.2  There  exist  invertible  finite  functions  of  order  n  which  cannot 
be  obtained  by  composition  of  generalized  and/nand  functions  of  order  strictly 
less  than  n. 

Proof.  In  the  context  of  the  proof  of  Theorem  5.1,  when  is  applied  to 
any  i  components  of  B"  this  set  is  divided  into  2n— 4  disjoint  collections  of  2* 
Tv-tuples,  and  each  collection  is  permuted  by  fiM  in  an  identical  fashion.  Thus, 
only  even  permutations  can  be  obtained  when  i  <  n.  Since  the  product  of  even 
permutations  is  even,  ouly  even  permutations  can  be  obtained  by  ono-to-one 
composition  of  any  number  of  and/nand  functions  of  order  less  than  n.| 

Remark.  According  to  this  theorem,  tie  and/nand  primitive  is  not  sufficient 
for  the  isomorphic  reversible  realization  of  arbitrary  invertible  finite  functions 
of  larger  order.  This  result  can  be  generalized  to  any  finite  set  of  invertible 
primitives,  as  implicit  in  the  proof  argument.  Thus,  one  must  turn  to  a  less 
restrictive  realization  schema  involving  source  aud  Bink  lines. 

Theorem  5.3  Any  invertible  finite  function  can  be  realized,  possibly  with 
temporary  storage,  [but  with  no  garbage!)  by  means  of  a  reversible  combina¬ 
tional  network  using  as  primitive  the  generalized  and/nand  elements  of  order 
<3. 

Proof.  In  view  of  Theorem  5.1,  it  will  be  sufficient  to  reali-e  (possibly  with 
temporary  storage),  for  each  n,  all  atomic  permuterB  of  order  r».  Since  these  can 
be  realized  isomorphically  from  fiW  and  fil")  (cf.  Figure  5.2),  it  will  be  sufficient 
to  realize  itself.  We  shall  proceed  by  recursion;  namely,  given  fit") 

can  Lt  realized  with  one  line  of  temporary  storage  as  follows. 

Construct  the  network  cf  Figure  5.3,  which  contains  two  occurrences  of 
(Kn—1i  and  one  occurrence  of  fl®.  Observe  that  c*  s  since  every  generalized 
and/nand  element  coincides  with  its  inverse  (&.,_  thus  the  second  occurrence  of 
tfin  ^  cancels  the  effect  of  the  first).  Therefore,  the  pair  ((c),  {</})  constitutes 
a  temporary-storage  channel.  When  c  =  0,  the  remaining  variables  behave  as 
the  corresponding  ones  of  #"),§ 
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Fig.  5.3  Realization  with  temporary  storage  of  from  &n~1)  (and  0®). 
In  this  network,  when  c  ■=  0,  also  </  ■=»  0,  and  the  remaining  component* 
behave  as  the  corresponding  ones  of 


In  the  above  construction,  it  is  clear  that  one  line  of  temporary  storage  is 
added  every  time  that  one  realizes  the  and/nand  function  of  the  next  higher 
order.  Thence  the  following  theorem. 

Theorem  5.4.  In  Theorem  5.3,  let  r,  be  the  order  of  the  given  invertible 
function,  and  m  the  number  of  source  (as  well  as  sink)  lines  required  required  for 
temporary-storage  channels  in  the  realization.  Then  m  need  not  exceed  n  —  3. 
If  only  0^  is  given  as  a  primitive,  then  m  need  not  exceed  3r»  —  3. 

Remark,  The  second  part  of  this  theorem  reSects  the  fact  that  additional 
temporary-storage  liues  are  needed  to  realise  not  from  and/nand  (cf.  (3.3)). 

The  proof  of  Theorem  5.3  establishes  a  general  mechanisms  for  bringing 
about  destructive  interfeience  of  garbage.  With  reference  to  Figure  5.3,  which 
can  serve  as  an  outline  for  the  general  case,  observe  that  the  left  portion  of 
the  network  is  accompanied  by  its  “mirror  image"  on  the  right.  The  left  por¬ 
tion  computes  an  intermediate  result  (on  the  line  running  from  c  to  <f)  that  is 
needed  ae  an  input  to  the  lower  portion  and  is  returned  by  it  unchanged.  Having 
performed  its  function,  this  intermediate  result  is  then  “undone”  by  the  right 
portion,  so  that  no  garbage  is  left. 

The  reader  may  refer  to  [3,7]  for  more  specific  examples  of  destructive  In¬ 
terference  of  garbage. 

Taken  together,  Theorems  5.3  and  5.4  have  sn  interesting  interpretation 
from  the  viewpoint  of  complexity  theory.  They  imply  a  trade-off  between  the 
number  or  available  primitives  and  the  availability  of  an  appropriate  amount  of 
a  resource  that,  as  we  shall  presently  explain,  can  be  intuitively  identified  with 
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temporary  storage  (hence  the  term  “temporary-storage  channel"  introduced  in 
Section  3,) 

Following  the  lines  of  the  proof  of  Theorem  5.3,  any  invertible  function  / 
(Figure  5.4a)  can  be  realised  by  a  network  of  the  kind  Illustrated  in  Figure  5.4b 
(where  only  some  relevant  details  have  been  indicated). 


Fio.  5.4  If  instead  of  an  ad  hoc  reversible  mechanism  (a)  for  the  invertible 
function  /  one  seeks  a  mechanism  bawd  on  the  and/nand  primitive,  as  in 
(b),  auxiliary  constant  input  signals  are  required.  Such  signals  are  returned 
unchanged  at  the  output. 

Let  us  consider  the  process  of  traversing  the  box  of  Figure  5.4b  from  left  to 
right.  Each  line  running  through  tlu  box  represents  the  evolution  of  a  binary 
storage  element.  In  general,  all  the  constants  entering  the  box  will  be  repeatedly 
written  over  as  they  traverse  the  box  itself;  yet,  they  will  emerge  from  the  box 
with  the  original  values.  In  this  context,  a  temporary  storage  channel  (such  as 

the  pair  ({ci . cr),  {</„ . . . ,  c/r}))  rep.-ients  a  "scratchpad"  register  which  is 

initialized  to  an  assigned  state  (say,  all  0’s)  and  is  invariably  restored  to  the 
original  state  before  the  end  of  the  computation.  (Though  more  general,  this 
behavior  is  analogous  to  that  of  the  reversible  Turing  machines  described  by 
Bennett[4]  and  briefly  discussed  in  Section  7.) 

In  this  context,  Theorem  5,2  can  be  interpreted  as  saying  that,  for  a  given 
choice  of  reversible  primitives,  it  may  be  impossible  to  carry  out  the  computation 
of  a  given  invertible  finite  function  if  one  is  restricted  to  working  on  a  register  of 
size  just  enough  to  contain  the  argument  (cf.  the  limitations  of  linear-bounded 
automata).  On  the  other  hand,  Theorem  5.3  says  that  this  difficulty  disappears 
as  soon  as  one  permits  the  use  of  an  auxiliary  temporary-storage  register  of 
appropriate  size. 

The  following  list  (cf.  Figure  5.5)  sums  up  in  a  schematic  way  the 
input/output  resources  of  which  a  reversible  network  must  avail  itself  in  order 


to  be  able  to  compute  a  finite  function 


-»►-  result 
—  garbage 

(c)  to.,  temporary  storage  channels 

(d)  constants  -*--1 _ U~  garbage 

Fig.  5.5  Classification  of  input  and  output  lines  in  a  reversible  combina¬ 
tional  network,  according  to  tbeir  function,  fa;  Argument  and  result  of  the 
intended  computation,  (b)  Constant  and  garbage  lines  to  account  for  the 
noninvertibility  of  the  given  function,  (c)  “Temporary  storage"  registers 
required  when  only  a  restricted  set  of  primitives  is  available,  (d)  Additional 
constant  and  garbage  lines  required  when  in  designing  the  network  one 
chooses  not  to  take  full  advantage  of  the  correlation  between  internal 
streams  of  data,  and  thus  looses  opportunities  to  bring  about  destructive 
interference  of  garbage. 

(a)  If  <£  is  invertible,  and  the  use  of  ad  hoc  primitives  is  allowed,  then  no 
source  or  sink  lines  are  necessary. 

(b)  If  0  is  not  invertible,  it  is  necessary  to  provide  source  lines  to  be  fed  with 
specified  constants  and/or  sink  lines  which  will  produce  garbage. 

(c)  Independently  of  the  invertibility  of  <f>,  if  only  a  restricted  set  of  primi¬ 
tives  is  allowed  it  may  be  necessary  to  supply  temporary-storage  channels  (i.e, 
additional  source  lines  to  be  fed  with  constants  and  an  equal  number  of  sink 
lines  which  will  return  constants). 

(d)  If,  in  order  to  simplify  the  mechanism,  one  chooses  to  ignore  that  cer¬ 
tain  streams  of  garbage  within  the  mechanism  are  correlated  and  thus  could  be 
subjected  to  destructive  interference,  then  further  source  and  sink  lines  will  be 
reo.uired,  as  in  (b). 


(a)  argument  -toi 

(b)  constants  -»~j 


0.  Conservative  logic 

In  view  of  the  considerable  exertions  that  were  necessary  in  the  previous 
sections  <n  order  to  obvsir  a  bona  fide  realiiation  of  mechanisms  having  universal 
logic  capab'.titi**,  aad  at  the  same  time  satisfying  the  "  ercibility  constraint, 
one  sn>gct  -^nder  whether  nontrivial  computation  would  be  possible  at  ail  if 
suhasautia!  further  constraints  were  imposed. 

Acs U  turns  out  shat  universal  logic  capabilities  can  still  be  obtained 
&  >-<  a  if  one  restricts  one's  attention  to  combinational  networks  that,  in  addition 
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to  being  reversible,  conserve  in  the  output  the  number  of  0's  and  i’s  that  are 
present  at  the  input.  The  study  of  such  netwcrks  is  part  of  a  discipline  called 
conservative  logic*  [7]  (also  cf.  [11]).  As  a  matter  of  fact,  most  of  the  results 
of  Sections  4  and  5  were  originally  derived  by  Frtdkin  and  associates  in  the 
context  of  conservative  logic. 

In  conservative  logic,  all  data  processing  is  ultimately  reduced  to  conditional 
routing  of  signals.  Roughly  speaking,  signals  are  treated  as  unalterable  objed.fi 
that  can  be  moved  around  in  the  course  of  a  computation  but  never  created  or 
destroyed.  The  physical  significance  of  this  principle  will  be  discussed  shortly. 

The  basic  primitive  of  conservative  logic  is  the  Frtdkin  gate  (ct.  [70]),  defined 
by  the  table 

c  *1  *2  d  to  to 

0  0  0  0  0  0 

0  0  1  0  10 

0  1  0  0  0  1 

0  1  1  0  1  1  (6« 

10  0  1P01  v  ' 

10  1  10  1 

110  110 

111  111 

This  computing  element  can  be  visualised  as  a  device  that  performs  conditional 
crossover  of  two  data  signals  a  and  b  according  to  the  value  of  a  control  signal 
c  (Figure  0.1a).  When  c  1  the  two  data  signals  follow  parallel  paths,  while 
when  c  •  they  cross  over  (Figure  6.1b). 

(a)  (b) 


Fta.  0.1  (a)  Symbol  and  (b)  operation  of  the  Fredkin  gate. 

In  order  to  prove  the  universality  of  this  gate  as  a  logic  primitive  for  reversible 
computing,  it  is  sufficient  to  observe  that  and  can  be  obtained  l.om  the  mapping 

^Resides  a  combinational  primitive  (the  1  redkin  gate  discussed  br’.ow),  conserva- 
tive  logic  also  posits  a  communication/memory  primitive  (the  unit  wire).  Together, 
these  two  primitives  are  sufficient  to  account  for  sequential  computation.  Moreover, 
they  provide  a  basis  for  a  theory  of  computation  complexity  which  incorporates 
certain  important  physical-like  constraints  that  are  usually  neglected. 
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(p,  q,  0}  >-♦  (p,  pq,  pq),  and  not  and  pan-out  from  the  mapping  (p,  1, 0)  *-*  (j>,p,p). 

There  exists  only  one  other  3-input,  3-output  conservative-logic  element-  that 
can  be  used  ae  a  universal  primitive;  this  is  the  symmetric  majority/parity  gate 
(bmp)  defined  by 

x  y  x  d  \j  J 

0  0  0  0  0  0 

0  0  1  i  0  0 

0  10  SOI 

Oil  -*110  (6.2) 

100  v  1  0  '  ’ 

10  1  011 

110  10  1 

111  111 

Intuitively,  in  the  bmp  gate  the  three  signals  are  rotated  in  one  direction  if  their 
overali  parity  is  even,  and  in  the  other  direction  if  it  is  odd.  While  the  smp  gate 
can  be  realized  isomorphically  by  means  of  Fredkin  gates,  a  realization  of  the 
latter  by  the  former  requires  a  temporary-storage  channel.  In  this  sense,  the 
Fredkin  gate  is  the  most  elementary  conservative-logic  primitive— since  no  2- 
input,  2-output  invertible  function  is  universal.* 

Finally,  the  Fredkin  gate  can  be  realized  IromorphlcxUjr  by  means  of 
and/nand  gates,  as  shown  in  Figure  B.2. 


Fig.  6.2  Isomorphic  realization  of  the  Fredkin  gate  by  means  of  and/nand 
gates. 

It  is  important  to  realize  that,  far  from  representing  merely  an  elegant  toup- 
de-force  in  the  theory  of  reversible  computing,  conservative  logic  provides  an  es¬ 
sential  connection  between  that  theory  and  the  physics  of  computing  circuits.  In 

'An  even  more  elementary  conservative-logic  primitive,  namely,  the  Interaction 
gate{7],  can  be  obtained  if  one  considers  invertible  function  whose  domain  and 
codomain  coincide  with  a  proper  subset  of  a  set  of  the  form  Bn. 
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fact,  while  in  any  reversible  system  whatsoever  there  are  a  number  of  conserved 
quantities,  in  physical  system  many  of  these  quantities  are  required  to  have  a 
special  structure.  For  instance,  energy,  momemtum,  and  angular  momentum 
are  additive  (this  reflects  certain  symmetries  of  space  and  time).  Intuitively, 
reversibility  by  itself  is  not  sufficient  to  give  enough  physical  “flavor”  to  a  theory 
of  computing. 

In  a  conservative  logic  circuit,  the  number  of  l's,  which  is  conserved  in  the 
operation  of  the  circuit,  is  the  sum  of  the  number  of  l’s  in  different  parts  of 
the  circuit.  Thus,  this  quantity  is  additive,  and  can  be  shown  to  play  a  formal 
role  analogous  to  that  of  energy  in  physical  systems.  Other  connections  between 
conservative  logic  and  physics  will  discussed  in  more  detail  in  [7] 

In  conclusion,  conservative  logic,  represents  a  substantial  step  in  the  develop¬ 
ment  of  a  model  of  computation  that  adequately  reflects  the  basic  laws  of  physics. 


7.  Reversible  sequential  computing 

In  Sections  4  and  5,  we  started  from  a  certain  computing  object  (v  iz.,  a 
finite  function),  and  we  discussed  the  conditions  for  its  reversible  realization 
first  (a)  as  an  object  of  the  same  nature  (viz.,  an  invertible  finite  function) 
treated  as  a  “lumped"  system,  thus  stressing  functional  aspects,  and  then  (b)  as 
a  “distributed"  system  (viz.,  a  reversible  combinational  network),  thus  stressing 
structural  aspects  and  paving  the  way  for  a  natural  physical  implementation. 

By  and  large,  we  shall  follow  a  similar  plan  in  dealing  with  the  more  com¬ 
plex  computing  objects  that  constitute  the  paradigms  of  sequential  computing, 
namely,  finite  automata  (in  the  present  section),  Turing  machines  (Section  8), 
and  cellular  automata  (Section  9). 

First,  we  shall  make  a  few  commemts  on  sequential  computing  in  general. 

In  Section  2,  we  defined  an  abstract  computer  as  a  function-composition 
scheme.  Some  of  these  schemes  possess  a  regular  structure  of  a  certain  kind, 
namely,  they  are  time-iterative,*  and  with  appropriate  conventions  can  be  rep¬ 
resented  much  more  compactly  in  terms  of  sequential  networks  (cf.  [9]). 

*1?  the  partial-order  relation  between  arcs  that  is  nduced  by  tile"  function- 
compoaition  operation  U  interpreted  as  a  causal  relationship  between  signals,  then 
certain  other  relations  between  arcs  are  naturally  interpreted  as  referring  to  spatial 
and  temporal  relationships.  In  this  context,  a  causal  network  may  possess  certain 
automorphisms  that  may  be  interpreted  as  time  shifts,  and  in  this  case  the  network 
is  time-iterative,  similarly,  it  may  possess  automorphisms  corresponding  to  spatial 
shifts,  and  in  this  case  it  is  space-iterative. 
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(7.1) 


Consider,  for  definiteness,  the  iterative  function-composition  scheme 


7i+l 

Vi-H  “*i®7< 


(—00  < » <  4-00), 


explicitly  represented  by  the  infinite  causal  network  of  Figure  7.1. 


y. 

Fto.  7.1  A  function-composition  scheme  having  a  time-iterative  structure. 


The  same  scheme  can  be  represented  by  the  finite  sequential  network  of  Figure 
7.2.  By  comparing  this  figure  with  Figure  7.1,  it  is  clear  that  the  role  of  the  so- 
called  “deity  elements''  in  a  sequential  network  is  to  mark  out  those  places  that 
correspond  to  the  boundary  between  one  stage  and  the  next  In  the  equivalent 
time-iterative  combinational  network. 


Fie.  7.2  The  same  function-composition  scheme  ar  represented  by  a  finite 
sequential  network. 

jr  the  previous  sections,  for  the  sake  of  realiiation  nrgu.i.  -'swe  have  treated 
a  finjte  function  as  a  combinational  network  consisting  of  a  single  node.  Similarly, 
wc  shall  ’  eat  1  finite  automaton  as  a  sequential  network  whose  combinational 
part  con i.  t-  of  a  single  node,  representing  the  automaton’s  transition  function. 
Thus,  for  *  .sample,  the  network  of  Figure  7.2  can  bt  identified  with  the  finite 
automaton  (>.,•/)  (*©?,* (). 
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Finally,  recalling  that  a  computation  is  a  solution  of  a  function-composition 
scheme  (cf.  Section  2),  let  us  note  that  one  is  usually  not  interested  in  arbitrary 
solutions;  rather,  one  seeks  solutions  corresponding  to  particular  boundary  con¬ 
ditions  (defined,  for  instance,  by  assigning  specified  values  to  the  input  lines). 
Moreover,  in  the  case  of  a  time-iterative  scheme,  one  is  usually  interested  only 
in  that  portion  of  the  scheme  whose  elements  are  indexed  by  *  >  to  (for  an 
arbitrary  io).  The  assignment  of  specified  values  to  the  new  input  lines  that 
are  created  in  this  way  (i.e.,  by  “cutting"  the  network  in  half)  corresponds  to 
initializing  the  delay  elements  in  the  sequential-network  representation. 


By  definition,  a  finite  automaton  is  reversible  if  its  transition  function  is 
invertible.  Thus,  in  order  to  realize  a  finite  automaton  by  means  of  a  reversible 
;-qi'entirl  network,  it  will  be  sufficient  to  take  its  transition  function,  construct 
a  reversible  realization  of  it,  and  use  this  as  the  combinational  part  of  the  desired 
sequential  network.  The  problem  of  reversibly  realizing  an  arbitrary  finite  func¬ 
tion  has  been  solved  in  Section  4.  Thus,  we  have  the  following  theorem. 


Teorem  7.1.  For  every  finite  automaton  r:  X  X  Q-*Q  X  Y,  where  X  «=» 
Bm,  Y  cm  Bn,  and  Q  ■=»  Bu,  there  exists  a  reversible  finite  automaton  t:  (Br  X 
Bm)  XBU-*BUX  (Bn  X  BT+m~n),  with  r<n- f  u,  such  that 


ti<0, ....  0,  . z™  . <7u)  —  rj(x|, . . . ,  xm,  fl, . . . ,  ?u),  (i  —  1 . ti-f  n). 


In  other  words,  whatever  can  be  computed  by  an  arbitrary  "nite  automaton 
according  to  the  scheme  of  Figure  7.3a  can  slsc  be  conpuisd  by  a  .  .vawib/e 
finite  automaton  according  to  the  Bchema  of  Figure  7.3b. 
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output 


Fig.  7.3  Any  Suite  automaton  (a)  can  be  realised  aa  a  reversible  finite 
automaton  (b)  having  a  number  of  auxiliary  input  line*  (source)  which  are 
fed  with  constants  and  a  number  of  auxiliary  output  lines  (link)  whose 
values  are  disregarded. 


The  following  theorem,  which  from  a  mathematical  viewpoint  ia  trivial,  is 
a  restatement  of  the  eecond  law  of  thermodynamics.  Recall  that  ."n  automaton 
is  closed  if  X  «=>  {X}  (i.e.,  there  are  no  input  lines);  open,  otherwise. 

Theorem  7.2  If  a  closed,  finite  automaton  is  not  reversible,  then  it  does 
not  admit  of  a  reversible  realisation  that  is  both  closed  and  finite. 

Proof.  Given  a  nonreversible  automaton  r:Q-*Q,  assume  that  t:  P—*P 
be  a  reversible  realization  of  v.  That  is,  we  assume  the  existence  of  an  invertible 
finite  function  t  and  of  two  maps  p  and  v  (respectively,  the  encoder  and  the 
decoder)  such  that,  for  all »  >  0, 


i4V<  =  r\  (7.2) 

Since  automaton  t  is  finite  and  reversible,  for  any  pGP  there  exists  an  ip >  0 
such  that  i*(p)  =  p.  Thus,  for  any  q  6  Q,  vt^pfa)  «■  vp(q).  But,  in  view  of 
(7.2),  vp(q)  «=  q  and  ut^p(q)  *=  r^\q).  As  a  consequence,  T*r^(?)  —  q  for 
all  q.  On  the  other  hand,  since  automaton  r  is  finite  and  nonreversible,  there 
must  be  at  least  on  such  that  r({?)  y*  ?  for  all  i  >  0.  Thus,  the  original 
assumption  leads  to  a  cortradiction.l 

Remark.  According  to  Theorem  4.1,  noninvertible  functions  can  be  com¬ 
puted  by  a  reversible  system  provided  that  a  supply  of  constants  is  made  avail¬ 
able.  In  an  open  system,  this  supply  may  come  from  some  Input  fines.  In  a 
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closed  system,  in  order  to  perform  a  computation  in  one  part  of  the  system  one 
may  draw  constants  from  another  part,  for  instance,  the  indefinitely  extended 
blank  tape  of  a  Turing  machine  (cf.  Section  8).  However,  if  the  system  is  also 
finite,  this  supply  will  eventually  run  out. 

Thus,  the  interpretation  that  a  finite,  closed,  and  reversible  system  "is 
modeling  an  irreversible  process"  can  only  be  maintained  tor  particular  initial 
conditions  and  on  a  space-time  scale  that  is  limited  with  respect  to  that  of  the 
entire  system. 

Having  discussed  the  realization  of  finite  automata  by  means  of  reversible 
finite  automata,  we  turn  now  to  the  realization  of  finite  automata  by  means  of 
reversible  finite  sequential  networks  based  on  given  primitives. 

It  is  clear  that  all  the  arguments  of  Sections  5  and  6  concerning  finite  func¬ 
tions  immediately  apply  to  the  transition  function  of  any  given  finite  automaton. 
In  particular,  in  analogy  with  Figure  5.5,  every  finite  automaton  can  be  realized 
by  a  finite,  reversible  sequential  network  based  on,  say,  the  and/nand  primitive 


Jb'ia.  7.4  Kealiiation  of  a  finite  automaton  by  means  of  a  finite,  reversible 
sequential  network. 

In  order  to  insure  the  desired  behavior,  the  state  components  represented  by  the 
temporary-storage  chancels  must  be  initialized  once  and  for  all  with  appropriate 
values  (typically,  all  0's),  while  the  source  must  be  fed  with  appropriate  constants 
(typically,  ail  0's)  at  every  sequential  step. 

In  a  conventional  computer,  power  dissipation  is  proportional  to  the  number 
of  logic  gates,  On  the  other  hand,  the  number  of  cocstants/garbage  lines  in 
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Figure  7.4  is  at  worst  proportional  to  the  number  of  input/output  lines  (cf. 
Theorems  4.1  and  5.3).  From  the  viewpoint  of  a  physical  implementation,  where 
signals  are  encoded  in  some  fotm  of  energy,  the  above  schema  can  be  interpreted 
as  follows:  Using  invertible  logic  gates,  it  is  ideally  possible  to  build  a  sequential 
computer  with  n to  internal  power  dissipation.  The  only  source  of  power  dis¬ 
sipation  arises  outside  the  circuit,  typically  at  the  input/output  interface,  if  the 
user  chooses  to  connect  input  or  output  lines  to  nonreversible  digital  circuitry. 
Even  in  this  case,  power  dissipation  is  at  most  proportional  to  the  number  of 
argument/result  lines,*  rather  than  to  the  number  of  logic  gates  (as  in  ordinary 
computers),  and  is  thus  independent  of  the  “complexity"  of  the  function  being 
computed.  This  constitutes  the  central  result  of  the  present  paper. 


8.  Reversible  Turing  machines 

We  shall  assume  the  reader  to  be  familiar  with  the  concept  of  Turing  machine. 
From  our  viewpoint,  a  Turing  machine  is  a  closed,  time-discrete  dynamical 
system  having  three  state  components,  i.e.,  (a)  an  infinite  tape,  (b)  the  internal 
state  of  a  finite  automaton  called  head,  and  (c)  a  counter  whcrae  content  indicates 
on  which  tape  square  the  head  will  operate  next.  Let  T,  H,  and  C  be  the  sets 
or  tape,  head,  and  counter  states,  respectively.  A  Turing  machine  is  reversible 
if  its  transition  function  t:TxHxC-*TxHxC  is  invertible. 

It  is  well  known  that  for  every  recursive  function  there  exists  a  Turing 
machine  that  computes  it,  and,  in  particular,  that  there  exist  computation- 
universal  Turing  machines.  Are  these  capabilities  preserved  if  one  restricts  one's 
attention  to  the  class  of  reversible  Turing  machines? 

The  answer  to  the  above  question  is  positive.  In  fact,  in  (4)  Bennett  exhibits  a 
procedure  for  constructing,  for  any  Turing  machine  and  for  certain  quite  general 
computation  formats,  a  reversible  Turing  machine  that  performs  essentially  the 
same  computations.  (The  concept  of  “reversibility”  used  by  Bennett  is  weaker 
than  ours,  insofar  as  the  transition  function  and  its  inverse  are  defined  only  on 
distinguished  subsets  of  tape/head/counter  states,  and  even  among  these  states 
there  are  some  with  no  predecessors  and  others  with  no  successors;  however,  the 
transition  rules  of  Bennett's  machine  can  easily  be  augmented  so  as  to  satisfy 

TIn  fact,  the  free  energy  that  must  be  supplied  is  at  most  that  in  which  the  input 
constants  are  encoded,  and  the  thermal  energy  that  must  be  removed  is  at  moat 
that  of  the  garbage  outputs.  According  to  Theorem  4.1,  the  number  of  constant 
lines  need  not  be  greater  than  that  of  result  lines,  and  the  number  of  garbage  lines 
need  not  be  greater  than  that  of  argument  lines. 
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cur  stronger  definition.  We  shall  assume  this  augmenting  procedure  to  have 
been  carried  out.) 

In  order  to  obtain  the  desired  behavior,  Bennett's  machine  is  initialized  so 
that  all  of  the  tape  is  blank  except  for  one  connected  portion  representing  the 
computation's  argument,  and  the  head  is  set  to  a  distinguished  “initial”  state 
and  positioned  by  the  argument's  first  symbol.  At  the  end  of  the  computation, 
i.e.,  when  the  head  enters  a  distinguished  “terminal"  state,  the  result  will  appear 
on  the  tape  alongside  with  the  argument,  and  the  rest  of  the  tape  will  be  blank. 

Thus,  a  number  of  tape  square*  that  are  initially  blank  will  eventually 
contain  the  result.  These  squares  fulfill  a  role  similar  to  that  played  by  the 
constants/garbage  lines  in  Section  5,  in  the  sense  that  they  provide  a  sufficient 
supply  of  “predictable"  input  values  (blanks)  at  the  beginning  of  the  computa¬ 
tion,  and  collect  the  required  e  mount  of  "random"  output  values  (in  this  case,  a 
copy  of  the  argument — cf.  the  first  row  of  (4.2))  at  the  end  of  the  computation. 

Moreover,  during  the  computation  a  number  of  originally  blank  tape  squares 
may  be  written  over  and  eventually  erased.  These  squares  fulfill  a  role  similar 
to  that  played  by  the  temporary-storage  lines  in  Section  5  (cf.  the  discussion 
centered  on  Figure  5.4). 

It  is  clear  that,  like  the  constants  in  the  reversible  combinational  networks 
of  Section  5,  the  blanks  in  Bennett's  machine  play  an  essential  role  in  the  com¬ 
putation,  sinte  without  their  presence  one  could  not  achieve  universality  and 
reversibility  at  the  same  time.  Intuitively,  computation  :a  reversible  systems 
requires  a  higher  degree  oi  "predictability  about  the  environment’s  initial  con¬ 
ditions  than  computation  in  nonrcversible  ones. 

Owing  to  the  “hybrid"  nature  of  a  Turing  machine,  which  involves  several 
kinds  of  computing  primitives  (an  active  device,  viz.,  the  head,  a  passive  device, 
viz.,  the  tape,  and  mechanisms  for  head-tape  interaction  and  for  head  move¬ 
ment),  it  is  difficult  to  discuss  the  realizability  of  a  Turing  machine  by  means 
of  a  reversible,  distributed  computing  mechanirm  before  having  expressed  the 
above  primitives  in  terms  of  fewer  and  more  elementary  ones.  For  this  reason, 
we  shall  deal  with  this  problem  at  the  end  of  the  next  section,  when  suitable 
tools  will  have  been  introduced. 


8.  Reversible  cellular  automata 

We  shall  assume  the  reader  to  have  some  familiarity  with  the  concept  of  cel¬ 
lular  automaton  (cf.  [21]  for  details  and  references).  Fiom  a  physical  viewpoint, 
cellular  automata  are  in  many  respects  more  satisfactory  models  of  computing 
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processes  than  Turing  machines;  in  particular,  they  allow  one  to  represent  by 
means  of  the  same  mathematical  machinery  and  at  the  same  level  of  abstraction 
not  only  a  computer  proper  but  also  its  environment,  the  interface  with  its 
“users,”  and  the  “users”  themselves [22],  A  cellular  automaton  is  in  essence  a  fc- 
dimensional  (fc  >  1)  array  of  identical,  uniformly  interconnected  Suite  automata, 
and  constitutes  a  closed,  timodiixrete  dynamical  system  whose  state  set  is  a 
countable  Cartesian  product  of  finite  sets  and  whose  transition  function  is  con¬ 
tinuous  (in  the  topological  sense)  and  commutes  with  the  translations  (i.e.,  with 
the  elements  of  the  array'll  symmetry  group).  A  cellular  automaton  is  reversible 
if  its  transition  function  is  invertible. 


It  is  well  known  that  there  exist  cellular  automata  that  are  ccmputation- 
and  construction-universal.  Are  these  capabilities  preserved  if  one  restricts  one’s 
attention  to  the  class  of  tewrsibk  cellular  automata?  The  answer  to  the  above 
question  is  positive.  In  fact,  in  [20]  Toffoli  exhibit:  a  procedure  for  construct¬ 
ing,  for  any  cellular  automaton  (presented  as  an  infinite,  space-iterative  sequen¬ 
tial  network),  a  reversible  cellular  automaton  that  realizes  it.  (Note  that  until 
then  the  existence  of  computation-  and  construction-universal  reversible  cel¬ 
lular  automata — which  is  thus  established— had  been  doubted  or,  by  erroneous 
arguments,  outright  denied.) 

Assuming  the  original  cellular  automaton  Af  to  be  one-dimensional  and  with 
the  von  Neumann  neighborhood  (Figure  9.1a),  with  Toffoli's  construction  one 
obtains  a  two-dimensional  cellular  automaton  M  in  which  the  flow  of  informa¬ 
tion  between  the  dements  of  the  array  (or  ceils)  can  be  visualized  as  in  Figaro 
9.1b. 

(«) 


(b)  ♦  X  X 


Fiq.  9.1  Information  flow  (a)  in  s  given  one-dimensional  cellular 
automaton  M,  and  (b)  in  the  corresponding  two-dimensional,  reversible 
realization  M. 


Each  row  of  M  constitutes  s  reversible  (infinite)  automaton  which  is,  of  course, 
open.  Let  us  consider  a  particular  row  p.  In  analogy  with  Figure  7.3,  let  ua 
interpret  the  arrows  entering  a  row  from  above  (in  Figure  9.1)  as  ©ource  linee, 
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and  the  ones  leaving  it  from  below  as  sink  lines.  By  construction,  when  the 
source  lines  are  fed  with  particular  constant  values  (all  0’s)  and  the  values  on 
the  sink  lines  are  ignored,  the  ‘'row"  automaton  will  behave  as  jCf .  In  order 
for  M  to  constitute  a  reversible  realization  of  M,  one  must  guarantee  that  p's 
source  lines  are  fed  with  0's  at  all  time  steps  t  >  0.  But,  by  construction,  if  a 
row  is  initialized  to  a  distinguished  blank  state  and  its  source  lines  are  fed  with 
0’s,  then  the  row  will  remain  in  the  blank  state  and  its  sink  lines  will  produce 
0's.  ThuB,  if  all  of  the  rows  that  lie  above  p  are  initialized  to  the  blank  state 
(Figure  9.2),  an  inexhaustible  supply  of  0's  will  “rain  down"  into  p.  At  the  same 
time,  p’s  sink  lines  will  produce  garbage  that  will  spread  down  and  sideways 


Fig.  9.2  With  proper  initialization,  the  reversible  two-dimensional  cellular 
automaton  M  realizes  the  one-dimensional  automaton  iCf,  which  may  be 
irreversible. 

In  Section  5,  we  saw  that,  starting  from  a  fixed,  finite  set  of  invertible  logic 
primitives,  one  cannot  obtain  an  isomorphic  invertible  realization  for  every  in¬ 
vertible  finite  function;  rather,  in  general  one  must  be  allowed  to  use  ad-hoc 
primitives  (possibly  as  “complex"  as  the  function  itself)  or  introduce  temporary- 
storage  channels  (thus  giving  up  isomorphism).  Similar  considerations  apply  to 
finite  automata. 

Consider  now  a  reversible  cellular  automaton  M.  M  can  always  be  realized 
as  a  reversible  sequential  network  with  temporary  storage.  Is  it  possible  to  con¬ 
struct  an  isomorphic  reversible  rcalizatiou  of  M  if  one  is.  given  a  free  hand  in 
the  choice  of  primitives!  Surprisingly,  the  answer  to  this  question  is  negative 
(Theorem  9.1  below). 

Lemma  6.1.  Lei  m  be  the  number  of  binary  state  variables  associated  with 
each  cell  of  a  cellular  automaton  Af ,  and  n  the  size  of  its  neighborhood.  A  neeea* 
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sary  condition  for  the  isomorphic  realizability  of  M  as  a  reversible  sequential 
network  is  that  m>n. 

Proof.  We  shall  sketch  the  proof  for  a  one-dimensional  cellular  automaton 
M  with  w  ■=  1,  n  ■=  2,  and  neighborhood  index  (0,-1)  (i.e.,  the  next  state  of 
cell  i  will  depend  on  the  current  state  :!  cell  i  itself  and  of  cell i —  1,  that  is, 
its  “left"  neighbor  ,  Assume  that  the  required  realization  M  exists;  it  will  have 
the  form  of  Figure  9.3s. 


•  -1  »  •+! 


Fig.  8.3  (a)  Overall  structure  of  the  (assumed)  isomorphic  reversible 
realization  of  M.  Details  of  the  combinational  part  of  such  realization:  (b) 
paths  from  each  cell  to  itself,  (c)  paths  from  each  cell  to  its  right  neighbor, 
and  (d)  nodes  implied  by  the  existence  of  such  paths. 

Since  each  cell  is  “affected"  by  itself,  there  will  be  paths  in  the  combinational 
part  of  M  as  in  Figure  9.3b;  similarly,  since  each  cell  iB  “affected”  by  its  left 
neighbor,  there  will  be  paths  as  in  Figure  9.3c.  Thus,  there  will  be  nodes  as  in 
Figure  9.3d.  These  nodes  cannot  stand  for  invertible  primitives  (note  fan-in  at  p 
and  fan-out  at  q)  unless  further  arcs  exist  (namely,  an  additional  arc  entering  p 
and  one  leaving  q).  Tn  turn,  these  arcs  imply  the  existence  of  new  nodes — and  so 
on  ad  infinitum— since  connecting  these  arcs  to  one  another  would  violate  the 
partial  ordering  (“causality”)  associated  with  function  composition).  Clearly,  it 
is  impossible  to  complete  the  construction  without  introd  ing  either  cycles  or 
paths  of  infinite  length,  g 

Theorem  9.1  There  exist  reversible  cellular  automata  that  do  not  admit 
of  an  iiKiuiorphic  reversible  realization. 

Proof.  In  [2J,  Amoroso  and  Patt  exhibit  reversible  cellular  automata  (more 
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amply  discussed  in  [21]}  with  m  *»  1  and  n  =*  4.  The  thesis  follows  from  Lemma 

6.1.0 

Finally,  it  is  well  known  that  any  Turing  machine  can  be  embedded  in  a 
suitable  cellular  automaton.  Thus,  according  to  the  foregoing  discussion,  any 
Turing  machine  can  be  realised  by  an  infinite  reversible  sequential  neworlc. 

10.  Conclusions  and  perspectives 

What  properties  of  an  abstract  computing  system  are  critical  in  determining 
whether  or  not  it  can  carry  out  a  given  task?  To  give  an  example,  it  is  known  that 
linearity  is  incompatible  with  computation  universality[15].  Many  other  issues, 
dealing,  for  instance,  with  monotonicity,  finiteness  of  storage,  availability  of 
constants,  etc.,  have  been  discussed  extensively  in  the  past  and  are  essentially 
settled.  On  the  other  hand,  only  recently  has  some  light  bees  thrown  on  the 
question  of  to  what  extent  the  imposition  of  the  reversibility  constraint  affects 
the  computing  capabilities  of  a  system.  The  sustained  debate  on  this  issue  has 
been  fueled  and  at  times  confused  by  obvious  connections  with  certain  physical 
questions. 

In  this  paper,  we  have  laid  down  the  foundations  for  the  theory  of  reversible 
computing,  i.e.,  a  theory  of  computing  based  on  invertible  primitives  and  com¬ 
position  rules  that  preserve  invertibility,  and  we  have  shown  that  this  theory  tan 
deal  satisfactorily  with  both  the  functional  and  the  structural  aspects  of  com¬ 
puting  processes.  In  particular,  those  structures  that  constitute  the  traditional 
paradigms  of  the  theory  of  computing,  such  as  combinational  and  sequential  net¬ 
works,  finite  automata,  Turing  machines,  and  cellular  automata,  have  been  as¬ 
certained  to  have  reversible  counterparts  of  equal  computing  power.  (Analogous 
considerations  apply  to  systems  of  difference  equations,  as  will  be  shown  in  a  later 
paper.)  Thus,  the  choice  to  use  reversible  mechanisms  in  describing  computing 
processes  iB  a  viable  one.  What  can  be  gained  from  this  choice? 

In  the  synthesis  of  an  abstract  computing  system  for  a  given  task,  the  re¬ 
quirement  that  the  system  be  reversible  can  in  general  be  met  only  at  the  coat 
of  greater  structural  complexity.  In  other  words,  one  may  need  more  (but  not 
many  more)  gates  and  wires.  However,  the  system's  very  reversibility  pre  mises 
to  be  a  key  factor  in  leading  to  a  more  efficient  ph;  sical  realization,  since,  at 
the  microscopic  level,  the  “primitives"  and  the  “composition  rules"  available 
in  the  physical  world  resemble  much  more  closely  those  used  in  the  theory  of 
reversible  computing  than  those  used  in  traditional  logic  design.  For  example, 
it  appears  that  conservative  logic  might  be  completely  modeled  by  processes  of 
elastic  collision  between  identical  pnrticles[7]. 
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Besides  questions  of  efficient  implementation  of  computing  systems,  there 
are  severs!  other  research  lines  to  which  the  concepts  of  reversible  computing 
may  give  a  substantial  contribution.  Here,  we  shall  limit  ourselves  to  naming 
a  few  on  which  some  preliminary  investigations  have  been  carried  out,  such 
as  error  detection;  numerical  analysis  and,  in  particular,  the  integration  of 
differential  equations;  number  theory  and  the  factoring  of  large  integers;  second- 
order  automata  and  state-reduction  techniques;  synchronization  of  computing 
processes;  and  cellular  automata  and  the  modeling  of  fundamental  physical  laws. 

The  main  reason  why  the  concept  of  reversibility  is  so  pervasive  is  the  fol¬ 
lowing.  In  every  reversible  system  there  are  a  number  of  quantities  (functions  of 
the  system's  state)  which  are  conserved,  i.e.,  which  are  constant  along  each  of  the 
system’s  trajectories  (cf.  the  “integrals  of  the  motion”  of  theoretical  mechanics). 
Both  in  mathematical  and  in  physical  research,  experience  has  shown  that  many 
interesting  properties  of  a  system  can  usually  be  expressed  in  terms  of  conserved 
quantities,  and  on  this  basis  one  can  often  make  nontrivial  statements  about  the 
behavior  of  a  system  or  a  class  of  systems  without  having  to  go  into  a  detailed, 
case-by-casc  analysis  of  their  operation. 

Thus,  in  the  more  abstract  context  of  computing,  the  lawB  of  “conservation 
of  information”  may  play  t.  role  analogous  to  those  of  conservation  of  energy 
and  momentum  in  physics. 


11.  Historical  and  bibliographical  notes 

The  computing  element  known  as  the  “Fredkin  gate"  was  apparently  first 
described  by  Quine  as  an  abstract  primitive,  and  was  known  to  PetrillOj.  Some 
conservative  (but  not  reversible)  circuits  using  complementary  signal  streams 
were  discussed  by  von  Neumann|25]  as  early  as  1952.  More  recently,  Kinoshita 
and  associates^  1]  worked  out  a  classification  of  logic  elements  that  “conserve"  0’s 
and  l's;  their  work,  mot*"-*' 1  by  research  in  magnetic-bubble  circuitry,  men¬ 
tions  the  possibility  oi  nergy-efficient  computation,  but  has  apparently 

little  concern  for  reversibility. 

The  and/nand  clement  was  known  to  Petri[10],  and  was  mentioned  en  pas¬ 
sant,  in  the  context  of  reversibility  arguments,  by  Landauer[12].  The  generalized 
and/nand  functions  were  introduced  by  Toffoli[20]  for  proving  the  universality 
of  reversible  cellular  automata. 

Doubts  about  the  computational  capabilities  of  reversible  cellular  automata 
were  first  expressed  by  Moorejlfi],  and  more  formally  stated  ns  a  conjecture 
by  Burks[5],  Other  pnrtiee  in  the  debate  were  Smltb(18],  Amoroso  and  Patt[2], 
Aladyev[l],  and  Di  Gregorio  and  Trautteur[8]. 
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Distributed  systems  which  are  not  reversible  per  se,  but  in  which 
computation-universal,  reversible  structures  can  be  embedded  by  proper  in¬ 
itialisation,  were  described  by  Priese[17). 

The  idea  that  universal  computing  capabilities  could  be  obtained  from  re¬ 
versible,  dissipationless  (and,  of  course,  nonlinear)  physical  circuits  apparently 
first  occurred  to  von  Neumann,  as  reported  in  a  posthumous  paper[26j.  This 
idea  was  also  aired  by  Bennett[4],  with  some  support  from  his  construction  of 
reversible  Turing  machines.  A  more  fcrmal  proof  of  the  physical  readability  of 
such  circuits  was  given  by  Toffoli(23],  and  some  concrete  though  not  yet  entirely 
practical  approaches  are  outlined  in  [8],  A  much  more  promising  approach,  based 
on  the  interaction  gate,  has  been  recently  suggested  by  Fredkin[7]. 

Owing  to  the  interdisciplinary  nature  of  the  subject,  it  is  quite  difficult  to 
locate,  evaluate,  and  credit  all  research  results  that  may  somehow  be  relevant 
to  reversible  computing.  We  shall  appreciate  any  contributions  to  the  above 
bibliographical  notes. 
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